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VECTOR ESTIMATION SYSTEM, METHOD AND ASSOCIATED ENCODER 



FIELD OF THE INVENTION 



This invention relates to an encoder and a vector 
estimation system and method for processing a sequence of 
input vectors to determine a filtered estimate vector for 
each input vector. The invention is particularly useful 
for, but not necessarily limited to, determining filtered 
estimate vectors to be encoded by a speech encoder and 
transmitted over a communication link. 



BACKGROUND ART 

A digital speech communication or storage system 
typically uses a speech encoder to produce a parsimonious 
representation of the speech signal. A corresponding 
decoder is used to generate an approximation to the speech 
signal from that representation. The combination of the 
encoder and decoder is known in the art as a speech codec. 
As will be apparent to a person skilled in the art, many 
segments of speech signals contain quasiperiodic waveforms. 
Accordingly, consecutive cycles of quasiperiodic waveforms 
can be considered, and processed, by a speech codec as data 
vectors that evolve slowly over time. 



An important element of a speech codec is the way it 
exploits correlation between consecutive cycles of 
quasiperiodic waveforms . Frequently, correlation is 

exploited by transmitting a single cycle of the waveform, 
or of a filtered version of the waveform, only once every 
20-30 ms, so that a portion of the data is missing in the 
received signal. In a typical decoder the missing data is 
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determined by interpolating between samples of the 
transmitted cycles. 

In general, the use of interpolation by a speech 
5 decoder to generate data between the transmitted cycles 
only produces an adequate approximation to the speech 
signal if the speech signal really is quasiperiodic , or, 
equivalently, if the vectors representing consecutive 
cycles of the waveform evolve sufficiently slowly. 
10 However, many segments of speech contain noisy signal 
L , components, and this results in comparatively rapid 

0 evolution of the waveform cycles. In order for waveform 
interpolation m an encoder to be useful for such signals, 

J:;; it is necessary to extract a sufficiently quasiperiodic 

01 15 component from the noisy signal in the encoder. This 
1,5 extracted component may be encoded by transmitting only 
- selected cycles and decoded by interpolation in the manner 
ST" described above. The remaining noisy component may also be 
hi encoded using other appropriate techniques and combined 
03 2 0 with the quasiperiodic component in the decoder. 

Linear low pass filtering a sequence of vectors 
representing consecutive cycles of speech in the time 
dimension is well known in the speech coding literature. 

2 5 The difficulty with this approach is that in order to get 

good separation of the slowly and rapidly evolving 
components, the low pass filter frequency response must 
have a sharp roll-off . This requires a long impulse 
response, which necessitates an undesirably large filter 

3 0 delay. 

A Kalman filter technique for estimating quasiperiodic 
signal components has been described by Gruber and Todtli 
(IEEE Trans Signal Processing, Vol. 42, No. 3, March 1994, 
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pp 552-562) . However, because this Kalman filter technique 
is based on a linear dynamic system model of a frequency 
domain representation of the signal, it is unnecessarily 
complex. It also assumes that the dynamic system model 
5 parameters (i.e. noise energy and the harmonic signal gain) 
are known. However, when considering speech coding, noise 
energy and the harmonic signal gain parameters are not 
known. 

10 A technique for determining the system parameters 

required in a Kalman filter using an Expectation 
J!* Maximisation algorithm has been described in a more general 

p setting by Digalakis et al (IEEE Trans Speech and Audio 

W Processing, Vol. 1, No. 4, Oct. 1993, pp 431-442). However, 

i 15 the technique is iterative, and in the absence of good 
M= initial estimates may converge slowly. It may also produce 

m a result that is not globally optimal. No prior art method 

is known for obtaining good initial estimates. Further, 
this method typically requires a significant amount of 

2 0 data, over which the unknown parameters are constant. In 
the context of speech coding, where the parameters change 
continuously, rapid estimation is essential, and therefore 
this method of applying the Expectation Maximization 
algorithm needs to be improved. 

25 

Stachurski (PhD Thesis, McGill University, Montreal 
Canada, 1997) proposed a technique for estimating 
quasiperiodic signal components of a speech signal. This 
method involves minimizing a weighted combination of 

3 0 estimated noise energy and a measure of rate of change in 
the quasiperiodic component. This method is highly complex 
and does not allow the rate of evolution of the 
quasiperiodic component to be specified independently. Nor 
does it allow for an independently varying gain for the 

3 5 quasiperiodic component. 
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In this specification, including the claims, the terms 
comprises, comprising or similar terms are intended to mean 
a non-exclusive inclusion, such that a method or apparatus 
5 that comprises a list of elements does not include those 
elements solely, but may well include other elements not 
listed. 



SUMMARY OF THE INVENTION 
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According to one aspect of the invention there is 
provided a vector estimation system for processing a 
sequence of input vectors, said input vectors each 
comprising a plurality of element values, and said system 
15 comprising: 

a digital filter with a filter vector input for 
receiving said sequence of input vectors and a 
predictor gain input for controlling characteristics 
of said filter, said digital filter also having both a 
20 current slowly evolving filter estimate output and a 

previous slowly evolving filter estimate output, said 
current slowly evolving filter estimate output 
providing a current filtered estimate vector of 
current filtered estimate element values of a slowly 
25 evolving component of said sequence of input vectors 

and said previous slowly evolving filter estimate 
output providing a previous filtered estimate vector 
of previous filtered estimate element values of said 
slowly evolving component of said sequence of input 
3 0 vectors; and 

a parameter estimator having an estimator vector 
input for receiving said sequence of input vectors and 
a previous slowly evolving filter estimate input 
coupled to said previous slowly evolving filter 
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estimate output, said parameter estimator further 
includes a predictor gain output coupled to said 
predictor gain input, 

wherein when said vector estimation system 
5 receives a current input vector that is one of said 

sequence of said input vectors, said parameter 
estimator provides a current predictor gain vector of 
current predictor gain element values at said 
predictor gain input each of said current predictor 

10 gain element values modifying one of said current 

filtered estimate element values at said current 
slowly evolving filter estimate output, each of said 
current predictor gain element values being dependent 
upon both said previous filtered estimate vector 

15 received at said slowly evolving filter estimate input 

and a said current input vector received at said 
estimator vector input. 

Suitably, said parameter estimator may be 
2 0 characterised by said current predictor gain element values 
being dependent upon both a sequence of previous input 
vectors and a sequence of said previous filtered estimate 
vectors . 

2 5 Preferably, said filter may have a predictor error 

variance output and an observation noise variance input, 
said predictor error variance output providing a current 
predictor error variance vector of current predictor error 
variance element values . 

30 

Suitably, when said vector estimation system receives 
said current input vector, said parameter estimator may 
provide a current observation noise variance vector of 
current observation noise variance element values at said 



observation noise variance output thereby modifying said 
current filtered estimate element values at said current 
slowly evolving filter estimate output, said current 
observation noise variance element values being dependent 
upon said previous filtered estimate vector received at 
said previous slowly evolving filter estimate input, said 
current input vector received at said estimator vector 
input, a said current predictor gain vector and said 
current predictor error variance vector. 

Preferably, the parameter estimator may have an 
unvoiced speech module that determines the current input 
vector's harmonic energy content by assessing the current 
predictor gain element values and depending upon the 
current predictor gain element values the parameter 
estimator selectively sets the current observation noise 
variance values . 

According to another aspect of the invention there is 
provided a vector estimation system for processing a 
sequence of input vectors, said input vectors each 
comprising a plurality of element values, and said system 
comprising: 

a digital filter with a filter vector input for 
receiving said sequence of input vectors and an 
observation noise variance input for controlling 
characteristics of said filter, said digital filter 
also having a current slowly evolving filter estimate 
output, a predictor error variance output and a 
previous slowly evolving filter estimate output, said 
current slowly evolving filter estimate output 
providing a current filtered estimate vector of 
current filtered estimate element values of a slowly 
evolving component of said sequence of input vectors, 
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said predictor error variance output providing a 
current predictor error variance vector of current 
predictor error variance element values and said 
previous slowly evolving filter estimate output 
5 providing a previous filtered estimate vector of 

previous filtered estimate element values of said 
slowly evolving component of said sequence of input 
vectors; and 

a parameter estimator having an estimator vector 
10 input for receiving said sequence of input vectors and 

a previous slowly evolving filter estimate input 
coupled to said previous slowly evolving filter 
estimate output, said parameter estimator further 
includes a observation noise variance output coupled 
15 to said observation noise variance input and a 

predictor error variance input coupled to said 
predictor error variance output, 

wherein when said vector estimation system 
receives a current input vector that is one of said 

2 0 sequence of said input vectors, said parameter 

estimator provides a current observation noise 
variance vector of current observation noise variance 
element values at said observation noise variance 
input each of said current observation noise variance 
25 element values modifying one of said current filtered 

estimate element values at said current slowly 
evolving filter estimate output, each of said current 
observation noise variance element values being 
dependent upon a said current input vector, a said 

3 0 current predictor error variance vector and a said 

previous filtered estimate vector. 



Preferably, the parameter estimator may have an 
unvoiced speech module that determines the current input 
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vector's harmonic energy content by assessing the current 
predictor gain element values and depending upon the 
current predictor gain element values the parameter 
estimator selectively sets the current observation noise 
variance values . 

Suitably, said digital filter may further include: 
a slowly evolving predicted estimate output providing a 
current predicted estimate vector of current predicted 
estimate element values of said slowly evolving component 
of said sequence of input vectors. The digital filter may 
also have a process noise variance input. 

Suitably, there may be a smoother module having inputs 
coupled respectively to at least two outputs of said 
digital filter. 

Preferably, said smoother module may have five inputs 
coupled to respective outputs of said filter. Preferably, 
said smoother module may have a smoothed estimate output 
providing a smoothed estimate value of a previous slowly 
evolving component . 

Suitably, said smoothed estimate output is coupled to 
a smoothed estimate input of said parameter estimator. 

According to another aspect of the invention there is 
provided a method for processing a sequence of input 
vectors each comprising a plurality of elements, said 
vectors being applied to a vector estimation system having 
a parameter estimator coupled to a digital filter, said 
method comprising the steps of: 

receiving said sequence of input vectors at 

inputs of said filter and said parameter estimator, 



said input vectors comprising a plurality of element 
values ; 

determining a current predictor gain vector of 
current predictor gain element values, each of said 
current predictor gain element values being determined 
from a said current input vector that is one of said 
sequence of said input vectors, said determining being 
effected by said parameter estimator; and 

applying said current predictor gain element 
values to said digital filter to thereby modify a 
current filtered estimate vector of current filtered 
estimate element values provided at an output of said 
digital filter, each of said current predictor gain 
element values being dependent upon a previous 
filtered estimate vector from said filter and said 
current input vector. 

Preferably, said step of determining may be further 
characterised by providing a current observation noise 
variance vector of current observation noise variance 
element values and a current predictor error variance 
vector of current predictor error variance element values 
from said current input vector. 

Suitably, said step of applying may be further 
characterised by said filter receiving said current 
observation noise variance element values thereby modifying 
said current filtered estimate element values, each of said 
current observation noise variance element values being 
dependent upon a said previous filtered estimate vector, 
said current input vector, a said current predictor gain 
element vector and said current predictor error variance 
vector . 
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According to another aspect of the invention there is 
provided a method for processing a sequence of input 
vectors each comprising a plurality of elements, said 
vectors being applied to a vector estimation system having 
a parameter estimator coupled to a digital filter, said 
method comprising the steps of: 

receiving said sequence of input vectors at 

inputs of said filter and said parameter estimator, 

said input vectors comprising a plurality of element 

values ; 

determining a current observation noise variance 
vector of current observation noise variance element 
values, each of said current observation noise 
variance element values being determined from said 
current input vector that is one of said sequence of 
said input vectors, said determining being effected by 
said parameter estimator; and 

applying said current observation noise variance 
element values to said digital filter to thereby 
modify a current filtered estimate vector of current 
filtered estimate values provided at an output of said 
digital filter, each of said current observation noise 
variance element values being dependent upon a said 
current input vector, a vector comprising current 
predictor error variance element values, and a vector 
of previous filtered estimate element values. 

Preferably, the filter may be a Kalman filter. 

According to another aspect of the invention there is 
provided an encoder for processing a speech signal, said 
encoder comprising : 
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a signal normalization module for processing the 
speech signal to provide a sequence of input vectors 
each comprising a plurality of element values; 

a digital filter with a filter vector input 
coupled to an output of the signal normalization 
module for receiving said sequence of input vectors, 
the digital filter also having an observation noise 
variance input for controlling characteristics of said 
filter, said digital filter also having a current 
slowly evolving filter estimate output, a predictor 
error variance output and a previous slowly evolving 
filter estimate output, said current slowly evolving 
filter estimate output providing a current filtered 
estimate vector of current filtered estimate element 
values of a slowly evolving component of said sequence 
of input vectors, said predictor error variance output 
providing a current predictor error variance vector of 
current predictor error variance element values and 
said previous slowly evolving filter estimate output 
providing a previous filtered estimate vector of 
previous filtered estimate element values of said 
slowly evolving component of said sequence of input 
vectors ; and 

a parameter estimator having an estimator vector 
input for receiving said sequence of input vectors and 
a previous slowly evolving filter estimate input 
coupled to said previous slowly evolving filter 
estimate output, said parameter estimator further 
includes a observation noise variance output coupled 
to said observation noise variance input and a 
predictor error variance input coupled to said 
predictor error variance output, 

wherein when said vector estimation system 
receives a current input vector that is one of said 
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sequence of said input vectors, said parameter 
estimator provides a current observation noise 
variance vector of current observation noise variance 
element values at said observation noise variance 
input each of said current observation noise variance 
element values modifying one of said current filtered 
estimate element values at said current slowly 
evolving filter estimate output, each of said current 
observation noise variance element values being 
dependent upon a said current input vector, said 
current predictor error variance vector and said 
previous filtered estimate vector. 

Preferably, the encoder may include an adder module 
with one input coupled to said slowly evolving filter 
estimate output and another input coupled to the output of 
the signal normalization module, wherein in use said adder 
subtracts the said current filtered estimate element values 
at the output of the vector estimation system from at least 
one of the elements of the sequence of input vectors. 

Suitably, an output of the adder module may be coupled 
to a rapidly evolving component encoder. 

Suitably, said parameter estimator may be 
characterised by said current predictor gain element values 
being dependent upon both a sequence of previous input 
vectors and a sequence of filtered estimate vectors. 

BRIEF DESCRIPTION OF THE DRAWINGS 

In order that the invention may be readily understood 
and put into practical effect, reference will now be made 
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to a preferred embodiment as illustrated with reference to 
the accompanying drawings in which: 

FIG. 1 illustrates a vector estimation system for 
processing a sequence of input vectors in accordance 
with a preferred embodiment of the invention; 

FIG. 2 illustrates a digital filter forming part 
of the vector estimation system of FIG. 1; 

FIG. 3 illustrates a parameter estimator forming 
part of the vector estimation system of FIG. 1; 

FIG. 4 illustrates a smoother module forming part 
of the vector estimation system of FIG. 1; and 

FIG. 5 illustrates a speech encoder that includes 
the vector estimation system of FIG. 1. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT OF THE 

INVENTION 

In the drawings, like numerals on different Figs are 
used to indicate like elements throughout. Referring to 
Fig. 1, there is illustrated a vector estimation system 1 
for processing a sequence of input vectors (y 0 to y T ) each 
of the input vectors comprising a plurality of element 
values y n i . The vector estimation system 1 includes a 
digital filter 2, a parameter estimator 10 and a smoother 
module 17 . The digital filter 2 has five inputs and five 
outputs. The five inputs of the digital filter 2 are a 
filter vector input 3, a predictor gain input 4, an 
observation noise variance input 5, an OnsetFlag input 2 6 
and process noise variance input 25. The five outputs of 
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the digital filter 2 are a current slowly evolving filter 
estimate output 6, a current slowly evolving predicted 
estimate output 7 , a previous filter error variance output 
9, a previous slowly evolving filter estimate output 20 and 
a current predictor error variance output 21. 

The parameter estimator 10 has four inputs and three 
outputs. The parameter estimator 10 inputs are an 
estimator vector input 19 coupled to the vector input 3; a 
previous slowly evolving filter estimate input 13 coupled 
to the previous slowly evolving filter estimate output 20; 
a current predictor error variance input 15 coupled to the 
current predictor error variance output 21; and a smoothed 
estimate input 16. The three outputs of the parameter 
estimator 10 are a predictor gain output 11 coupled to the 
predictor gain input 4; an observation noise variance 
output 12 coupled to the observation noise variance input 
5; and an OnsetFlag output 22 coupled to the OnsetFlag 
input 2 6 . 

The smoother module 17 has six inputs one being 
coupled to the slowly evolving filter estimate output 6; 
one coupled to the slowly evolving predicted estimate 
output 7; one coupled to the previous filter error variance 
output 9; one coupled to the previous slowly evolving 
filter estimate output 20; one coupled to the predictor 
error variance output 21; and one coupled to the predictor 
gain output 11. The smoother module 17 also has a smoothed 
estimate output 18 providing an output for the vector 
estimation system 1, the smoothed estimate output 18 is 
coupled to the smoothed estimate input 16 of the parameter 
estimator 10. 
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Referring to Fig. 2, the digital filter 2 is a comb 
filter in the form of a Kalman Filter Bank. The digital 
filter 2 comprises a Kalman gain determination module 30 
with one input being the observation noise variance input 
5 5. There is also a filtered state estimation module 31 with 
one input being the vector input 3 and another input being 
coupled to an output of the Kalman gain determination 
module 30. An output from the filtered state estimation 
module 31 provides the slowly evolving filter estimate 
10 output 6 that is coupled to an input of a previous filtered 
state adjustment module 33. Other inputs of the previous 
filtered state adjustment module 33 are provided by the 
OnsetFlag input 2 6 and the vector input 3 via a delay 
module 34. 

15 

An output from the previous filtered state adjustment 
module 33 provides the previous slowly evolving filter 
estimate output 20 that is coupled to an input of a 
predicted state estimation module 35. Another input to the 

2 0 predicted state estimation module 35 is provided by the 

predictor gain input 4. An output of the predicted state 
estimation module 35 provides the slowly evolving predicted 
estimate output 7 that is coupled to an input of the 
filtered state estimation module 31. 

25 

The output from the Kalman gain determination module 
3 0 is also coupled to an input of a filter variance 
estimation module 32 that has an output coupled to an input 
to a previous filter variance adjustment module 36. An 

3 0 output from the previous filter variance adjustment module 

3 6 provides the previous filter error variance output 9 
that also provides an input to a predictor variance 
estimation module 37. Other inputs to the predictor 
variance estimation module 37 are provided by the predictor 
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gain input 4, process noise variance input 25, OnsetFlag 
input 26 and observation noise variance input 5. An output 
from the predictor variance estimation module 37 provides 
the predictor error variance output 21 that is coupled to 
5 inputs of the Kalman gain determination module 30, the 
filter variance estimation module 32 and previous filter 
variance adjustment module 36. Other inputs to the 
previous filter variance adjustment module 3 6 are provided 
by the predictor gain input 4, the process noise variance 
10 input 25 and the OnsetFlag input 26. 

Cf As will be apparent to a person skilled in the art, 

1*1 the characteristics of the digital filter 2 are formalised 

J;S in equations (l)-(6) below. 

U! 15 

jjj At an nth input vector y n (a current input vector) of 

s the series of input vectors {y 0 to y T ) received by the 

;Y;! system 1, the previous filtered state adjustment module 3 3 

fSj provides, at the previous slowly evolving filter estimate 

03 2 0 output 20, a previous filtered estimate vector x, , of 

r: previous filtered estimate element values x. ... 

fss» r , n-l , i 

The OnsetFlag input 26 is a binary signal input that 
indicates whether or not the beginning of a signal segment 

25 containing a significant amount of harmonic energy 
(determined by a threshold value) has been detected. If 
OnsetFlag input 2 6 is set to a value that indicates that 
the beginning of such a segment has been detected, then the 
previous filtered estimate vector x f n _ x is set to a 

3 0 previous input vector y n _ x 

For the current input vector y n , the digital filter 2 
provides a current predicted estimate vector x of 

P; n 

current predicted estimate element values x . at the 

p f n , i 
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predicted estimate output 7 . Each of the current predicted 
estimate element values x„ „ . are computed according to: 

x p,n,i = a n,i- X f,n-l,i (1) 

Where i is an index identifying an element of a vector; 

and a is a current predictor gain element value of a 
n, i 

current predictor gain vector a n for an ith element in the 
nth input vector y n , provided at the predictor gain input 
4. 



Once the current predicted estimate vector x is 

p , n 

computed, then also for the current input vector y n a 
current filtered estimate vector x f of current filtered 
estimate element values n . is provided at the slowly 
15 evolving filter estimate output 6 Each of the current 
filtered estimate element values x f n i are computed 
according to : 

x, . = x^ „ . + K . . (v . - x„ „ . ) (2) 

20 

Where K n i is a current Kalman gain element value in a 
current Kalman gain vector K n for the digital filter 2 for 
the ith element of the nth current input vector y n . 

25 The Kalman gain element value K ni is computed 

according to: 

K n,i - 2 p,n,i / ^p.n,i + <4 > ~ < 3 ) 

3 0 Where, Z p n i is a current predictor error variance 

element value in a current predictor error variance vector 
Z p n provided at the predictor error variance output 21 for 
the ith element of the nth input vector y ; and cr 2 .is a 
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current observation noise variance element value in a 
current observation noise variance vector <7* provided at 

the observation noise variance input 5 also for the ith 
element of the nth input vector y n . 

If the OnsetFlag is set to a value that indicates that 
the beginning of a signal segment containing a significant 
amount of harmonic energy has been detected, then the 
current predictor error variance vector Z p n is typically 
set to the observation noise variance vector G 2 V . This 

results in Equation (3) producing the current Kalman gain 
element value K n i equal to 0.5 for all elements of the 
Kalman gain vector K n . 

If the OnsetFlag is set to a value that indicates that 
the beginning of a signal segment containing a significant 
amount of harmonic energy has not been detected, then the 
current predictor error variance element values £ p n ± are 
computed according to : 

S p,n.i = a n ,i- a n,i- 2 f.n-l.i + <C "—(4) 

2 

where a w is a process noise variance value provided at 
the process noise variance input 25; and 2 f n _ 1 i is a 
previous filtered error variance element value in a 
previous filtered error variance vector 2, - for the ith 

f,n-l 

element of a previous input vector y n ^ 1 . 

If the OnsetFlag is set to a value that indicates that 
the beginning of a signal segment containing a significant 
amount of harmonic energy has not been detected then a 
current filtered error variance element value S £ of a 

t , n, 1 

current filtered error variance vector 2 f provided at 
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the output of the filter error variance estimation module 
32, is computed according to: 

2 f,n,i = (1 " K n,i>- 2 p,n.i "~ <5> 

If the OnsetFlag is set to a value that indicates that 
the beginning of a signal segment containing a significant 
amount of harmonic energy has been detected, then each 
current filtered error variance element value is 

£ ,n, i 

computed according to: 



Referring to Fig. 3 there is illustrated the parameter 
estimator 10 that typically comprises an initial parameter 
estimation module 40, an unvoiced speech adjustment module 
41 and a voicing onset adjustment module 42. The initial 
parameter estimation module 40 has four inputs provided by 
the predictor error variance input 15, the previous slowly 
evolving filter estimate input 13, the vector input 19 and 
the smoothed estimate input 16. Outputs of the initial 
parameter estimation module 40 are coupled to inputs of the 
unvoiced speech adjustment module 41 and further inputs to 
module 41 are provided by the predictor error variance 
input 15, the previous slowly evolving filter estimate 
input 13 and the vector input 19. Outputs of the unvoiced 
speech adjustment module 41 are coupled to inputs the 
voicing onset adjustment module 42 and a further input to 
module 42 is provided by the vector input 3. The voicing 
onset adjustment module 42 has three outputs providing the 
predictor gain output 11, observation noise variance output 
12 and OnsetFlag output 22. 
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The initial parameter estimation module 40 computes 
initial estimates of the current predictor gain element 
values a . and the current observation noise variance 

' 1 2 

element values a . . These are determined as follows: 

vn, i 

<*nj =«.(i»«^»- a n,m a -l) (7 a) 

^=<ft^o-Vi) (8a) 



O where a nSS „.a _ x and 2> n0 . . . b n m ^ t are the parameters of the 



respective current predictor gain element values otnj and 
current observation noise variance element values &1 n these 



15 parameters are assumed to be constant for each vector (each 
Lj value of n) . The number of parameters for <z rt is defined by 

the index m a and the number of parameters for b n is defined 

fjj by the index m^. The index i ranges from 1 to N within each 

vector. Since consecutive vectors represent adjacent cycles 
S 2 0 of the waveform, an element with index i=0 for an nth 
M vector also represents the element with index i=N for the 

(n-1) th vector. 

In general, the functions in (7a) and (8a) may take on a 
25 variety of forms. In one preferred embodiment, where 
indexes m a and equal 2, the parameter estimator 10 

computes estimates of the current predictor gain element 
values a . and the current observation noise variance 

±1 r ± 



element values <7 t 2 , as follows: 



^=a n , 0 +a nA .i/N (7b) 

^t/=(&„,o+V I ' /Ar ) 2 <8b) 
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It may be assumed that smoothness constraints apply to 
a . and cr 2 at boundaries between each cycle (input 

n, 1 <v ' 

5 vector) . We may assume, for example, that the function 
a n(i> a n,o>-~ a n,m a -i) evaluated at f = 0 is the same as 
a n _ x (i, a n _ hQ , . . . a n _ Um ^ ) at i = N , and that <rj (i\ a rt>0 , . . . a n ^ ) 
evaluated at / = 0 is the same as {Ua n _ i # 9 ...a n _ l x ) at i = N. 

Hence a n0 is equal to Ct n _ lN , and b n0 is equal to ^ a l n _^ • 
10 Furthermore, <2 n4 is calculated using the below equation (9) 
as follows: 

a n , = — & - p — { 9 ) 

1=1 

15 And the parameter £>„, is calculated by substituting 

equation (8b) into the below equation (10) . 

i & iyj-y ml x /*j) , 

^ = 1 — (10a) 
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In order to determine fe ni we need to substitute cr^ f by 
using equation (8b) and then substitute for x f n , by using 
equations (2) and (3) . This results in the following 
equation (10b) : 

2.., 




2T-(y„., -«„,,^/, n -i,,) 




=1 -(10b) 
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As will be apparent to a person skilled in the art, 
from equation (10b), b nl can be determined by an iterative 
method, such as the Newton-Raphson algorithm. 

5 The unvoiced speech adjustment module 41 determines 

whether the current input vector y n represents a segment of 
speech that contains no significant harmonic energy, and if 
so selectively sets the current predictor gain vector otp 
and the current observation noise variance vector 4 

10 appropriately. Preferably, the unvoiced speech adjustment 
unit determines that the current input vector y n represents 
a segment of speech that contains no significant harmonic 
energy by detecting whether either of the following 
conditions is true: 
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(i) a . is less than 0.0; or 

n , x 



(ii) both ol . is greater than 1.0 and the initial 
estimation of the observation noise variance value 
is greater than mean squared value of elements in 
20 the current predicted estimate value. 

If either conditions (i) or (ii) hold, then typically 

the unvoiced speech adjustment module 41 will set a to 

2 n/ 1 

1.0, and re-compute cr 4 accordingly using Equation (8). 

25 

The voicing onset adjustment module 42 determines if 
the current input vector y n represents the second cycle of 
a segment of speech containing a significant amount of 
harmonic energy, and if so adjusts current predictor gain 
3 0 element values a n j and the observation noise variance 
element values <r^ f to more appropriate values and sets the 

OnsetFlag to a value indicating that voicing onset has been 
detected. 
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Typically, the voicing onset adjustment module 42 
determines that the current input vector y n is the second 
cycle of a segment of speech containing a significant 
amount of harmonic energy as follows. An input prediction 
gain, [3, is computed according to: 

P = (y„ T - y»-i> / (y n -i -y n -i> --<iu 



Input prediction error variance values, a e i , are 
computed according to: 

°e,i 2 = ^ T -(y nr i " P-Yn-1> / N "<"> 
2 2 

where a e i is the same for all elements in the vector a e . 

The voicing onset adjustment unit determines whether both 
of the following conditions are true: 

2 2 
(m) a e ± is less than k^. a v ^ , wherein k x is a constant, 

whose value is typically 0.9. 

2 

(iv) a e ± divided by the mean squared value of the elements 
of the input vector is less than k 2 , wherein k 2 is a 
constant, whose value is typically 0.5. 

If both conditions (iii) and (iv) hold, then typically the 
voicing onset adjustment unit will set a . to B and set 

2 n, 1 ■ 

a\ , to o . . 

Referring to Fig. 4 there is illustrated the smoother 
module 17 that typically comprises series coupled smoothed 
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state estimation modules 50 a first stage of which has an 
input receiving the current filtered estimate value x f#n . 
The final stage of the smoothed state estimation module 50 
provides a smoothed estimate value x f/n _j at output 18 of a 
previous slowly evolving component. The smoother module 17 
also has five sets of series coupled delay modules 
51,52,53,54 and 55 with respective outputs of an jth delay 
module 51,52,53,54 and 55 providing inputs to an j+lth 
smoothed state estimation module 50. 

The smoothed state estimation modules 50 provide 
smoothed estimates X Bf(n _ j)#i for successive values of j 
beginning with j=l. These estimates are computed according 
to : 



X s,(n-j),i = X f,(n-j),i + C - (X s,(n-j+l),i " X p, (n- j + l ) , i ) (13 



wherein 



2 0 and 



C = (^.a-d.i-^.i^^a-^l.i)* " (14) 



X s,n,i = X f,n,i "< 15 > 



From the above it will be apparent that the purpose of 
25 the smoother module 17 is to provide an estimate X S((n _.> of 
the slowly evolving component of an input vector based 
upon input vectors up to and including y n . The smoother 
module 17 thus uses current data to estimate a past slowly 
evolving component value, in contrast to the digital filter 
30 2, which uses current data to estimate a current slowly 
evolving component value. 
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In use, the vector estimation system 1 receives the 
sequence of input vectors y Q to y T that are each comprising 
N elements. Each of the input vectors y 0 to y T contains a 
sampled period of a presumed guasiperiodic signal. This 
5 sampled signal is typically time warped to allow for 
variations of quasiperiodic periods, so that each input 
vector contains the same number of elements, as will be 
apparent to a person skilled in the art. Alternatively, 
consecutive input vectors y Q to y T may have elements added 

10 to them or removed from them, again so that the resulting 
number of elements in each is the same. For an nth 
iteration, an input vector y n will be applied to vector 
input 3 and estimator vector input 19. The digital filter 
2 processes this input vector y n resulting in the slowly 

15 evolving filter estimate output 6 providing, to input 13, 
the previous filtered estimate vector x f n _ 1 of a slowly 
evolving component of sequence of vectors y 0 to y T . 

The parameter estimator 10 processes the previous 
20 filtered estimate value x f and current input vector y n 
to provide a current current predictor gain vector oc n at 
predictor output 11. The current predictor gain vector an 
is thereby applied to input 4 of the digital filter 2 for 
controlling the gain thereof during filtering of input 
25 vector y. The parameter estimator 10 determines the 
current predictor gain element values a ni for the current 
predictor gain vector a n by the calculation stated in 
equation (7b) . 

3 0 As will be apparent to a person skilled in the art, at 

initialisation (i.e. the first sample time when n is 0 
therefore input vector y 0 is applied to digital filter 
system 1) , there will be no previous filtered estimate 
element values x frll _ 1#i . Accordingly, although there are 
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many ways to allocate values for the previous filtered 
estimate values x f n _ 1 ± , the present invention preferably 
assigns the previous filtered estimate values x f n _ 1 i with 
the same element values as input vector y Q . 

5 

Referring to Fig. 5, the vector estimation system 1 
can advantageously be included in a speech encoder 60. The 
speech encoder 60 includes a signal normalization module 61 
with an input for receiving a speech signal. A signal 

10 vector output 62 of the signal normalization module 61 is 
coupled to filter vector input 3 and another output is 
coupled to the process noise variance input 2 5 of the 
vector estimation system 1. The signal vector output 62 is 
also coupled to an input of an adder module 63 and another 

15 input of the adder module 63 is coupled to the smoothed 
estimate output 18 of the vector estimation system 1. An 
output from the adder module 63 is coupled to an input of a 
rapidly evolving component encoder 64 and there is also a 
slowly evolving component encoder "65 having an input 

20 coupled to the smoothed estimate output 18. The speech 
encoder 60 has three outputs from the signal normalization 
module 61, for coupling to a speech decoder, these outputs 
being a spectral envelope output 66, an energy parameters 
output 67 and a period parameters output 68. The speech 

25 encoder 60 also has a slowly evolving component output 69 
from the slowly evolving component encoder 65 and a rapidly 
evolving component output 70 from the rapidly evolving 
component encoder 64 . 

3 0 In operation, the speech encoder 60 firstly normalizes 

a speech signal with respect to its spectral envelope, 
energy and period. The normalisation process involves 
estimating parameters that describe the spectral envelope, 
energy and period of the input signal and these parameters 
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are typically transmitted to a speech decoder at outputs 
66,67,68. The process noise variance provided at the 
process noise variance input 25 is typically used to 
control the vector estimation system 1. The normalisation 
process produces the sequence of input vectors (y 0 to y T ) 
for the vector estimation system 1. The sequence of input 
vectors (y 0 to y T ) are a sequence of fixed length vectors 
representing sampled consecutive cycles of the normalised 
waveform. These vectors (y 0 to y T ) are applied to the 
filter vector input 3 of the vector estimation system 1, 
which generates a slowly evolving component at the smoothed 
estimate output 18. By subtracting this slowly evolving 
component from the input vectors (y 0 to y T ) , a rapidly 
evolving, or noise-like component is produced and provided 
to the rapidly evolving component encoder 64. The slowly 
evolving and rapidly evolving components are encoded 
respectively by the slowly and rapidly evolving component 
encoders 65, 64,. The encoders 64,65 use appropriate 
methods known in the art to produce parameters at 
respective outputs 70,69 which are transmitted to a speech 
decoder . 

Advantageously, the present invention provides for the 
vector estimation system 1 to receive the current input 
vector y n that is one of the sequence of input vectors y 0 to 
y T . The parameter estimator 10 then provides the current 
predictor gain element values oc if at the predictor gain 
output 11, thereby modifying the current filtered estimate 
element values x. . at the slowly evolving filter estimate 
output 6 (see equations (1) and (2)). The current 
predictor gain element values a n ± are dependent upon the 
previous filtered estimate vector x f ^ and the current 
input vector y n (see equations (7b) and (9)) As will be 
apparent to a person skilled in the art, the parameter 
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estimator 10 determines the current predictor gain element 
values a n ± from both a sequence of input vectors y n to y 0 
and a sequence of previous filtered estimate vectors x f ^ 0 to 

X f ,n-l* 

The present invention also advantageously allows for 
the parameter estimator 10 to provide the current 
observation noise variance values cr* ti at the observation 

noise variance output 12, thereby modifying current 
filtered estimate element values x. . at the slowly 
evolving filter estimate output 6 (see equations (2) and 
(3)). The current observation noise variance element 

values a 2 . are dependent upon the current input vector y , 

the current predictor gain element vector a n , the current 
predictor error variance vector 2p,n# and the previous 
filtered estimate vector x f ± (see equations ((10a), (10b) 
and (8b) ) . 

The detailed description provides a preferred 
exemplary embodiment only, and is not intended to limit the 
scope, applicability, or configuration of the invention. 
Rather, the detailed description of the preferred exemplary 
embodiment provides those skilled in the art with an 
enabling description for implementing a preferred exemplary 
embodiment of the invention. It should be understood that 
various changes may be made in the function and arrangement 
of elements without departing from the spirit and scope of 
the invention as set forth in the appended claims. 



